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Abstract 

In this paper we investigate parametrization-free solutions of the prob- 
lem of quantum pure state preparation and subspace stabilization by 
means of Hamiltonian control, continuous measurement and quantum 
feedback, in the presence of a Markovian environment. In particular, we 
show that whenever suitable dissipative effects are induced either by the 
unmonitored environment or by non Hermitian measurements, there is no 
need for feedback control to accomplish the task. Constructive necessary 
and sufficient conditions on the form of the open-loop controller can be 
provided in this case. When open-loop control is not sufficient, filtering- 
based feedback control laws steering the evolution towards a target pure 
state are provided, which generalize those available in the literature. 

1 Introduction 

In the ever growing spectrum of applications of control-theoretic methods to 
quantum mechanical systems, and in particular in the control of molecular dy- 
namics [351 HOI El , m cooling nano-electromechanical devices [55], in controlling 
optical systems [3j3 [35] and in manipulating a variety of physical supports for 
quantum information processing [331 148j , state preparation problems maintain 
a central role. In particular, pure states, the maximal information states for 
quantum systems, are sought, e.g. as initial states for enacting controlled energy 
transitions, as states of minimal energy for cooling procedures, and, especially 
entangled ones, as fundamental resources for quantum information processing. 
When the system state is not pure, or not precisely known, the "classical" 
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Lie-algebraic or optimal, open-loop, coherent control design methods are not 
sufficient to attain purification, and some interaction with an external system, 
environment or measurement apparatus is needed in order to complete the con- 
trol task. 

We here consider the problem of global asymptotic stabilization of pure 
states, and subspaccs, of finite-dimensional systems interacting with a Marko- 
vian environment and undergoing continuous measurement processes. The most 
general description of these systems is provided by the so-called Stochastic Mas- 
ter Equation (SME), the quantum equivalent of a Kushner-Stratonovich equa- 
tion for the probability density in the classical case [TUES]. This can be obtained 
from a suitable system/field interaction model by means of non-commutative 
filtering theory [U [9] . Quantum subspace stabilization is of key interest in quan- 
tum information encoding and error correction, and can often be treated with 
slight generalizations of the same methods [4"T] . 

From a control-theoretic viewpoint, the problem is doubtless challenging. 
The SME is a nonlinear, control-affine, matrix Stochastic Differential Equation 
(SDE) with state in the compact set of positive-semidefinite, unit-trace Her- 
mitian matrices. In addition to this, some intrinsic symmetries in the action 
of noise prevent standard design methods to work. Different approaches have 
been used: we refer the reader to the survey papers [37J US] an d the book 
[48] for a comprehensive review. In particular, stabilizing feedback laws based 
on the real-time estimate of the system state (hence often called bayesian, or 
filtering-based techniques) have been presented in [14j [47j [52] ■ In particular, 
the approach of [47] is based on a (convex) numerical Lyapunov design, viable 
for low-dimensional systems, since the numerical design procedure suffers from 
scalability problems, being based on explicit parametrizations whose sixe grow 
quadratically with the dimension of the system. The filtcring-bascd approach 
has also been shown to be robust with respect to small delays in the control loop 
[20] , and to initialization of the filter [45] . A more general theoretical framework 
to solve the problem has been presented in [3T]: here the need for numerical 
methods is bypassed by resorting to switching controllers. However, in order 
to apply this approach to systems that differ from the ones considered in [31] . 
one would have to tailor the solution to the problem under consideration by 
adapting part of the results to each specific model. 

In order to find a constructive and flexible approach to control design, we 
here review this class of control problems bringing in the picture two new ele- 
ments: open-loop, time-invariant Hamiltonian control, and Markovian environ- 
ments. Assuming we can engineer open-loop, time-independent Hamiltonians 
on the system, we provide necessary and sufficient conditions for pure state and 
subspace stochastic stabilizability (in probability) for a large class of systems, 
exploiting either the dissipation effects induced by the measurement or the noise 
processes but without requiring feedback control. It is worth observing that in 
practical applications the use of real-time feedback is an extremely challenging 
task which entails the computation-intensive real-time integration of the SME, 
while open-loop, time-independent solutions appear to be a more viable option 
in many practical situations |43| . 
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Other ways of substituting real-time feedback with open-loop control have 
also been sought in [13], with some key differences: the open loop control is 
"impulsive" , i.e. consists in a sequence of unitary rotations at discrete time in- 
tervals, while the quantum filter acts continuously on the whole control interval; 
the tasks considered are those of rapid purification, where the target state is 
not decided a priori, but it is only required to be pure, or as pure as possible, 
as well as rapid measurements. 

When no suitable dissipation effect (neither monitored nor unmonitored) is 
available, we show that open-loop control is not enough to achieve the desired 
stabilization. In this case we can resort to a feedback method, and we illustrate 
how a time-dependent Hamiltonian, driven by a suitable feedback control law 
can bridge the gap, ensuring stabilization at least in expectation of a target 
pure state. The design of the feedback law we pursue follows (31], with some 
differences that arc worth remarking: (i) it takes into account, and exploits, the 
effect of the open- loop Hamiltonian and the environment; (ii) it is parametriza- 
tion free, and the method directly applies to a fairly wide class of models; (iii) 
the assumption we make are such that the role of the feedback part in the con- 
trol strategy is "minimal" , i.e. is used only to enable state transitions that the 
open-loop control cannot produce. Further implications of these facts will be 
discussed in the conclusions. 

The paper is structured as follows: in Section[5]we recall the class of models 
we will consider, along with some of their basic properties. Section [3] is devoted 
to characterize invariant subspaces, and subspaces that cannot be such, for the 
SME. We do so by resorting to the properties of an associated deterministic sys- 
tem: a key role is played by the support theorem [31] [22] [21] , which is recalled 
in Appendix [A] together with some results of stochastic stability that will be 
needed in the following sections. Building on these results, Section B~TI provides 
necessary and sufficient condition for the open-loop, environment-assisted sta- 
bilization of the SME. When these conditions are not matched, we illustrate an 
effective strategy including feedback in Section B~2l 

2 Models for quantum dynamics with noise and 
measurement processes 

We need to recall some basics of quantum mechanics, quantum filtering and 
stochastic stability theory we will use later on. For an excellent introductory 
exposition to the statistical description of quantum systems see e.g. [2B]. More 
details can be found in e.g. [29] [35] and references therein. For the theory 
of stochastic stability, main references are [U [19l [23] : we recall the results of 
interest in Appendix [A] 

A finite-dimensional quantum system Q, with Hilbcrt space H. over the com- 
plex field C, is considered. Let Q3("W) represent the set of linear operators on 
H, with Sj(T-L) denoting the real subspace of Hcrmitian operators, and I being 
the identity operator. The adjoint of A € 55(H) denoted by . Our knowl- 
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edge of the state of Q is condensed in a density operator p on "H, with p > 
and tr(p) = 1. Density operators form a convex set, denoted D('H) C $){%)■ 
Observables are represented by Hermitian operators in Sj(T-l). 

2.1 Quantum filtering equation 

The most general and rigorous method to derive the state dynamics for a given 
system, while this is subjected to continuous observations, relies on quantum 
probability theory, and in particular quantum filtering theory [7J [5J [H] • The 
result is a stochastic differential equation for the estimated state conditioned 
on the measurements, driven by the noise process deriving from the measure- 
ment process. We recall in the following the form of dynamics including only 
homodyne-detection measurements [501 [5] , and hence driven by continuos gaus- 
sian white noise. While for the sake of simplicity we consider only one measure- 
ment channel at a time, the results could be extended to multiple commuting 
measurement processes (see also [T2]). 

Let (£l,£,P) a (classical) probability space and {Wt,t £ R + } a standard 
R-valued Wiener process defined on this space. The homodyne-detection mea- 
surement record yt can be represented as: 

d Vt = y/v^tT(p t (L + Ll))dt + dW t , (1) 

where Lq is the linear operator associated to the measurement process and 
< r] < 1 represents the efficiency of the measurement. We denote by St the 
filtration associated to {Wt,t £ R + }. 

The associated evolution of the state pt £ D('H) conditioned on the measure- 
ment record |T]) is the quantum filtering or Stochastic Master Equation (SME) 
a la Ito: 

dpt = lF(H, Pt )+^V{L k ,pt)\dt + g{L ,p t )dWt, (2) 

I fc=0 J 

where 

T(H,p) :=-i[H,p], 

V(L,p):=Lptf -hpLp + ptfV), (3) 

G(L, p) := ^j(Lp + pL^ - tr((L + tf)p)p). 

The term T is associated to the Hamiltonian of the system, which is given 
by a drift and a (bilinear) control part H = H Q + uHf, while T>(Lq, p) and 
Q(Lq,p) are the drift and diffusion parts introduced by the weak measurement 
of the operator L £ 03 (%q). The additional drift terms T>{L].,p), determined 
by the noise operators £ 05 {Hq), k = 1, . . . ,n, account for the non- unitary 
dynamics induced by interactions with an (unobservable) environment. The 
solution {pt} uniquely exists and is adapted to the filtration £ t and ©("H)- 
invariant by construction, see [47l|8]. Considering (fTJ and ([2]) together, one can 
recognize the basic structure of a Kalman-Bucy filter. Other correspondences 
and differences with the classical setting have been highlighted in e.g. [15| l3T]. 
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2.2 Quantum dynamical semigroups and their properties 

The drift part of © is linear, and the associated linear system, which is time- 
invariant if the control u is constant, plays the role of the Kolmogorov's forward 
equation (or Fokker-Plank equation) associated to the SME © : 

j t p(t) = C{p{t)) = F[H,p{t)]+j2v{L k ,p{t)). (4) 

fe=0 

C is the generator of the Markov semigroup associated to @, i.e. a Quantum 
Dynamical Semigroup (QDS) generator in the language of statistical quantum 
mechanics |25U17| . The resulting evolution is a continuous, one-parameter semi- 
group of Trace-Preserving, Completely-Positive (TPCP) maps {7I(-)}t>o- 

In the study of open quantum systems for quantum thermodynamics [TJ [TU] , 
quantum control [1H1 [21 [371 ED HS] , and quantum information [TJ [TU1 [33J , the 
dynamical properties of QDS's have been thoroughly investigated. In order 
to develop a system-theoretic analysis of the system, essentially a theory of 
controlled invariants j6] , a linear algebraic representation and its block decom- 
position turned out to be insightful [2U E2] • We here recall some results on the 
stability of a subspace Hs oiH. Consider a decomposition: 

H = H S ®H R . (5) 

Let s = dim(Hs), and let {\cj>j)}j =1 , {l^f)}™^ be orthonormal bases for 
7~Ls, Hr, respectively. Then, the natural basis for H, {\f m )} = {|0f)}?=i U 
{l^f)}™^, induces a block structure for matrices acting on %: 



X 



X S 


x P 




Xr 



(6) 



We denote by II. the projector onto T~L,. In the block structure, for instance, 
lis is represented in the following form 



n 



s = 



Is 












The system with state p G T>(H) is initialized in Hs with state p' € D(Hs) 
if ps — p', pp — , pp : = 0. Denote by 3s(T-l) the set of states that satisfies the 
above condition for some p' . With a slight abuse of terminology we say that Hs 
is an invariant subspace for the dynamics (j4|) if 3 sift) is an invariant subset of 
Q(H). Necessary and sufficient conditions for the blocks of H and L k to ensure 
invariance are given by the following proposition |41j . 

Proposition 2.1 Assume that T~L = Hs © Hr, and let H , {L k } be the Hamil- 
tonians and the error generators in Q). Then, Hs is invariant iff Vfc 



Lk,s 


Lk,p 





L k ,R 



L k = 
iH P - ■ 



o H L !,S L >. 



(7) 
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With the same terminology as above, we say that Hs is an "attractive" subspace 
with respect to a family of TPCP maps {7t}t>o if 3s(H) is an attractive set, 
that is if 

Vp G D(H), lim 

£— > oo 

A subspace which is invariant and attractive is called Globally Asymptotically 
Stable (GAS). The following theorem characterizes the generators that allow for 
open- loop Hamiltonian stabilization of a given subspace |42j . 

Theorem 2.1 Let H = Hs © Hr, with Hs invariant for Assume that we 
can apply arbitrary, time-independent control Hamiltonians. Then Hs can be 
made GAS iff Hr is not invariant. 

Hence, by applying Proposition 12.11 to Hr, we explicitly see that Hs can be 
made GAS if, in addition to the condition £fc,Q = Vfc, implying the invariance 
of S, we have that L^.p ^ for some k. Furthermore, following the proof of 
Theorem 12.11 a stabilizing Hamiltonian that satisfies the invariance condition 
can be constructed explicitly |42j . 

3 Invariant and attractive subspaces for the SME 

In order to connect the invariance properties of subspaces of the ME to those of 
the SME, we will study the properties of a set of linear deterministic differential 
equations and invoke the support theorem. This section closely follows the ideas 
of Section 3 of |31| , and in particular the support theorem which is recalled in 
the Appendix (Theorem lA.ip . 

In order to prove invariance of T)(H) and other useful results, in |31) a linear 
diffusion, which plays the role of the Zakai equation in the quantum setting, has 
been used: 

dp t =T(H t ,p t )dt + Y,V{L k ,pt)dt 

k (9) 

+ Vv ( L oPt + Pt L l) dyt- 

This equation preserves nonnegativity of the (pseudo) state p, but does not 
preserve its trace. However, it is easier to prove the existence of its solution as 
it obeys global Lipischitz conditions, and the unique strong solution of ([2]) can 
be found from solutions of ([9]) as pt = pt/tipt- Let us: 

(i) rewrite the initial state in spectral form 

Pa = X! /',''/'•/ ' = ^Pjpi; 

j j 

(ii) introduce a new Wiener process W(, independent of yt, and define Wj = 
y/vUt + \/l — vWl- We are now in the position to construct a process that is 



Tt{ P ) 



Ps(t) 



(8) 



G 



equivalent in law to pt from the solution of the set of equations: 

dpi =F{H tl ~p> t ) dt + Y,V(L k , ft) dt 

k (10) 
+ ^j(L Q pi+pi4)dW t , 

and then defining p t = ^-(Y^j PjPt I -^Y)i where Tj is the filtration associated to 
the measurement process Y t . By Ito's rule one can verify that the solutions v\ 
of linear vector equations in Ito form: 



dv{ 



(-iH t - i J2 L h L k\ v t dt + L ovfdW t , (11) 

satisfy v{v{^ = p{, solution of (|T0|) . Adding the Wong-Zakai correction^ to the 
drift, we obtain the equivalent Stratonovich form: 

dv{ = (-iH t - i £ L l Lk - \ L l\ v t dt + L ° v t ° dW t- (12) 

Notice that W t = \frjYt + \/l — 17 W/ is a process with drift. By Girsanov's 
theorem we can find another measure Q that is equivalent to P and for which 
Wt is a Wiener process. The last equation, with respect to the measure Q, 
satisfies all the hypothesis of Theorem lA.il We shall now use it to connect a.s. 
invariance of subspaces for the SME to their invariance for the ME. 

Theorem 3.1 T-Ls is an invariant subspace for the ME ([4]) if and only if3s{T~L) 
is invariant for the SME a.s. 

Proof. Recall from Proposition 12.11 that H$ is invariant for ^ iff Lh,Q = 0, Vfc 
and —iHp — | ^ k L^ gLj, p = 0. Taking into account these conditions in the 
deterministic differential equation 

j t vt = (-iH t -\Y, L k L k - |^oJ «f + u tLov t , (13) 

we get that both the "state" and the "input" matrices have an upper-triangular 
block structure induced by the decomposition H = Hs © T~Lr: 



dt Vt = 







v t + u t 







v t . (14) 



1 Consider a random process Xt on C n , two functions A, B : C" — > C" (C 1 and C 2 , 
respectively), and denote by X;, Aj, Bi their i-th components. An Ito SDE of the form dXt = 
A(Xt)dt + B(Xt)dWt, can be transformed (up to some technical conditions) to Stratonovich 
form dXt = A s {X t )dt + B(X t ) o dWt with corrected drift [18] 



a sA x) = mx )+ 1 J2^1b j (x) 



2 

j 
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Hence, for any control input and initial vector vq G Hs, it will be v t G Hs for 
any t > 0. Call Ws,v the set of continuous path v on t G [0,oo] starting at 
vq such that Hnv t = 0, t > 0. Since is closed in the topology of uniform 

convergence on compact scts0 , from (|27[) we have S Vo C Ws,v Q - By applying 
the support theorem IA.11 we also have that 1 = Q({ui G ft : v(uj) G 5u }) = 

G ft : »(w) G W S ,„J). 
On the other hand, assume Hs to be invariant for the SME a.s. so that for all 
po in 3s{T~L), and t > 

n s E(pt)n s = E(n s p t n s ) = E( Pt ) 

= Pa 



Hence is invariant for the semigroup dynamics driven by the ME. 



□ 



It is also easy to see that subspace invariance can be checked by directly resorting 
to the simple deterministic equation (|13l) . 

Corollary 3.1 A subspace Hs is invariant for the ME (H|) if and only if it is 
invariant for (|13[) for any Ut ■ 

Proof. From the proof of the previous proposition we have the "only if" im- 
plication. On the other hand, if Hs is invariant for ([TU)) , it is easy to sec 
that it must have the block structure of (fl4j) . and hence Lk.q = 0, Vfc, and 
-iH P -^ k L kiS Ll P = 0. 

□ 

The next negative result will be a key part of the feedback-assisted stabi- 
lization strategies. Let us define the following nonnegative function V\{p) := 
tr(nRp), which is linear in the state, and is zero if and only if the state is in 
?s{H). 

Proposition 3.1 Assume Hr does not support invariant sets for the ME 
Then for every fixed time T 

X(p) = mm EVi(pt) < 1, V Po G 3 R (H). (15) 



2 We can decompose every trajectory v(t) = Tlgv(t)+Uiiv(t) = vg(t)+vn(t), and ||f(t)|| 2 = 
H^sMII 2 + II^h(*)I| 2 - If a sequence of continuous {v k } converges uniformly on compact sets 
to v, v is continuous and we have for every compact K C R + 

lim sup \\v k (t) - v(t)\\ = = lim sup \\v k (t) - v(t)\\ 2 . 

If {^l fe } 6 W s ,„ for all k, then ||u£(t)|| = for all t, and \\v k (t) -v(t) || 2 = \\v k -v s || 2 + \\v R || 2 . 
In order for the limit above to be zero, it must be sup tgK ||^i?(t)|| 2 = for every K. Since 
wc can cover M+ with compact sets, we have that vji(t) = for all t > 0. Hence each limit 
v G Ws,v t which is thus closed. 
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In order to prove this proposition, we will make use of the following property of 
linear deterministic autonomous systems. 

Lemma 3.1 Consider a linear system it = Axt, Xt G H = Hs ® Hr. Assume 
xq G Hr, and that Hr does not contain any A-invariant subspace. Then for 
any T > there exists t < T such that xt (f. Hr. 

Proof. Assume by contradiction that for some T and some x$ € Hr, we have 
HsXt = 0, for all < t < T, with Us the orthogonal projection on Hs- Hence 
Hse At xo = for < t < T, which is equivalent to say that Xq is in the non- 
observable subspace for the LTI autonomous system 

x t = Ax t ,y t = TL s x t . 

This is true iff = HsA k xo with k = 0, . . . ,n — 1. Thus the subspace 

H Xa = span{x , Ax , . . . , A n ~ 1 x } C Hr, 

and by the Calcy-Hamilton theorem is A-invariant (and it is the smallest sub- 
space that contains the whole trajectory), contradicting the initial assumption. 

□ 

Proof of Proposition \3.1[ As in (|2?p , call S Xo the closure of the set of tra- 
jectories of (fT3)) with piecewise-constant controls starting from xq, and call Wr 
the set of continuous paths that do not leave Hr up to time T, which is closed 
in the uniform topology. Assume by contradiction that (|15|) is not true. Then 
it must be Q(Wjj) = 1 (which is equivalent to P(W^) = 1). But the smallest 
closed set of continuous paths that has probability 1 is S Xo , and hence it should 
be 

However, if Hr does not support invariant sets for the ME, Corollary 13 . 1 1 implies 
that it does not contain invariant subspaces for the deterministic system (|13|) 
as well. Then by Lemma 13 . 1 1 every trajectory exits T-Lr in (any) finite interval 
in which the control is not zero, so <S Xo ^ Wj£, getting a contradiction. □ 

4 Stabilization of the SME 

4.1 Environment- Assisted Stabilization 

Stabilization of the SME can be achieved in open loop, provided that the noise or 
the measurement operators can bridge the dynamics towards the target subspace 
"Hg, i.e. at least one of L^ p is nonzero. In this case, it will suffice to: (i) 
prove that the if Hs is GAS for the ME, it is also GAS in probability for the 
corresponding SME; and (ii) exploit Theorem 12.11 to construct an open-loop 
Hamiltonian that renders Hs GAS for the ME. The next proposition addresses 
the first issue. 
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Proposition 4.1 If3 s (H) is GAS for the ME ^ then it is GAS in probability 
for the SME fj|. 

Proof. Consider the function V\ (p) as a Lyapunov function candidate. It is zero 
iff pr = 0, i.e., p £ 3s(H), and positive for any p ^ Js('H). Moreover, direct 
computation yields 



AVi{p) = -tr 



\Y, L k,p L k,p S j Pr) 



where A(-) is the infinitesimal generator of the SME @. By the cyclic property 
of the trace, we observe that AVi(p) < for any p £ Q(H). Thus, by Theorem 
IA.21 it follows that 3s{T~L) is stable in probability. To prove (by contradiction) 
it is also attractive, suppose that for some p £ ®(H) \ 3s('H), 3s(H) is not 
attractive for $Z§, i.e. with finite probability p > : 



(lim 9(* t (po), Jsr(«)) =0) = 1 -p, 



where the probability measure P is the one induced by the Wiener process in 
([2]) and c)(-, •) is defined in (|28|) . Thus, by the properties of V\, it must also be 

pflim V 1 ($ t (po))=o) =l-p- (16) 

\t— >oo / 

From the definition of the expectation, 

E[Vi(* t (po))] = / ^i(*t(po))dP. 

^{Vi(*t(po))>0} 

Now, either the set {Vi($t(po)) > 0} has measure zero, contradicting (fT6"|) . or 
there exists a (non-random) function w(po) > such that the following inequality 
holds 

lim sup E[Ki(* t (/*>))] 

= lim sup / Vi($*(po))dP 



£— >oo 



{Vi(*t(po))>0} 



By "reverse" Fatou's Lemma, we obtain: 



> v(p Q ) lim sup / d¥ 
t^co J{y 1 (* t ( (9o ))>o} 

= «(/>o)limsup{l-P(Vi(* t (po)) = 0)}. 



Hmsupf;[Vi($ t (po))] > w(po) 1 - P Iimsup^i(* t (po)) = ) }> = w(p )p- 

£— >oo ^ \ £— >oo 

By linearity of the expectation and the trace 

E[y 1 ($ t (p ))] = Fi(E[$ t (p )]). 
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Finally, by continuity of V\ , there exists a constant k such that 

limsu P o(E[<D t (po)], 35(H)) > > 0. 

Since the time evolution of E[$ t (po)] is given by (@}, this would imply that 
3s (H) is not attractive for ((4]). Thus, the assertion is proved. □ 

Theorem 4.1 Let W = %$ © Hi?, and assume that at least one of Lk^p is not 
zero, and that L^^q = 0, Vfc. Then, there exists an open-loop control Hamilto- 
nian such that 35(H) is GAS in probability for the SME H|). 

Proof. Let H be a Hamiltonian defined by 






H ,p 








with H .p = —H p — 7; ( Ylk -^1 s^k.pj ■ According to Proposition 12.11 the 

Hamiltonian H' Q = H +H renders 3s (H) invariant for the ME. By Theorem l3.ll 
it is also a.s. invariant for @. On the other hand, note that by the assumption 
on Lk,p for some k, 3r{'H) is not invariant. Thus, by invoking Theorem 
2. H we can find H c such that 3s (H) is attractive for the dynamics (J4j) with 
H" = H' + H c , and still leaves the target subspace invariant. Finally, by 
Proposition H31 we have that 3s(H) is GAS in probability for the dynamics ((2]) 
with H" = H'„ + H r . □ 



One can indeed prove that the hypothesis of Theorem 14.11 are also necessary 
for open-loop stabilization. This is formalized in the following Corollary, which 
completes Theorem 14. 1[ establishing the limits of the open- loop approach. 



Corollary 4.1 Let % = T-Ls ® o,nd assume that L^^p = for all ks. Then 
3s{T~l) cannot be rendered GAS in probability with open-loop control alone when 
the dynamics is given by (0). 

Proof. If we chose H ,p = 0, all the operators in $2$ would be block diagonal and 
it is easy to verify that also the set 3p(T-l) would be invariant for the resulting 
ME, and hence a.s. invariant for the SME dynamics. Hence 3s('H) could not be 
attractive in probability for @. On the other hand, choosing H a p 7^ would 
violate the conditions for the invariance of 3s{T~L) in Proposition 12. II □ 



4.2 Feedback- Assisted Stabilization 

In the following, we will show that the addition of the time-dependent term, 
along with a suitable feedback law u(pt), will allow to render GAS in ex- 
pectation even when the open-loop method fails, namely when Lk,p = for any 
k. However, in order to do so, we will restrict our attention to a slightly less 
general class of problems and measurements. 
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Assumption 1: Let dim('Hs) = 1, that is, we are seeking stabilization of a given 
pure state pd- 

The second assumption regards the structure of the feedback Hamiltonian. 
Recall that: 

H t = H + u(t)H f , (17) 

where the u(t) is a control field and Hf is fixed, while we assume as before we 
are free to design the time- independent part H Q , in order to "destabilize" the 
undesircd invariant sets for the dynamics. A trivial, necessary requirement for 
Hf, in order to obtain the desired stabilization, is to dynamically "connect" the 
target (one-dimensional) subspace Hs to Hp. 

Corollary 4.2 Let H = Hs © Wr and assume that Lk,p = for all k 's. If the 
feedback Hamiltonian block Hfp = 0, then there does not exist a choice of H a 
and u(t) such that 3s{H) is GAS in probability for j^J. 

Proof. The proof follows that of Corollary 14.11 assuming Hf y p = 0, either we 
choose H ,p = 0, rendering 3p(H) invariant, or we choose H a p ^ 0, rendering 
3s(H) not invariant. □ 

It is then necessary to assume that the off-diagonal blocks of Hf are not zero. 
On the other hand, in order to ensure invariance of 3s{H), by Proposition ^. II 
we need to assume a block diagonal open-loop Hamiltonian, that is i/ ,p = 0. 
The following design assumption can be relaxed, but it would add up to the 
quite involved notation of the next sections. 

Assumption 2: In order to simplify the design and analysis of the control strat- 
egy, we assume -ff/,s = and Hfp = 0. 

Lastly, we restrict the class of measurements with a technical assumption that 
is required in the proof of Lemma T4.2I below. 

Assumption 3: Lq is a normal operator with non-degenerate spectrum. 

Since we already assumed that we are in the case where Lk,p — for all fcs, 
and Lk.s is a scalar, this last assumption affects only the block Lq r. 

4.2.1 Construction of the open-loop control Hamiltonian 

The first step in our design approach, for both the open- and closed-loop strate- 
gies, is to design an open-loop Hamiltonian H Q ensuring that there exist no 
invariant sets with support only in Hp. This result will be used in the open- 
loop approach directly (Section [4. ip . and in the closed-loop approach to prove 
that H' Q = H a + uHf, for some constant control u, "destabilizes" the subspace 
Hp (Section \FFZ$. 

It will be convenient to consider a refinement of the Hilbert space decom- 
position by further splitting Hp into orthogonal subspaces. Any choice of or- 
thonormal basis of each space in the right-hand side of H = Hs © He ®Hz 
induces a block decomposition for matrices representing operators on H: 



X = 


( x s 


X v 


X v \ 




X c 


Xw 




X Y 


X z J 
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where Xs, Xjj, Xt, Xc are in fact scalar since Hs,Hc have dimension one. In 
particular, the choice of the He is made so the feedback Hamiltonian has a 
simple form: define He = span{_ffj- p } C Hr, where Hj p must non zero due to 
Corollary 14. 2 [ and Hz = Hr He- In the induced block decomposition, given 
the assumptions in Section [4.21 we then have: 





( H . s 













H .c 


H .w 




1 o 


Kw 


H ,z 



I 


H S;U 




H f - H *f,U 








V o 





o / 



(18) 





( Lk,s 








L k = 





Lk,c 


Lk,w 




V o 


Lk,Y 


Lk,z 
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The following technical Lemma will be used in constructing an open-loop Hamil- 
tonian that prevents any subset of 3z(H) from being invariant. 

Lemma 4.1 Given a ME (j4|) and a decomposition H = Hs © He © Hz-, the 
associate dynamics does not admit invariant subsets in 3z(H) if for any p € 
3z(H) either: 

Y^LkwPzLlw^O, (19) 

k 

or 

- iH . w pz + (L k:W p z Ll z - \ {L\ c L k y/ + L,\ Y L k ,z)pz) ^ 0. (20) 



Proof. By direct computation of the blocks of the ME, one finds its C, W^-blocks 
to be 



k.yv> 



C-k.w — —iHo,wPz + [Lk,wPzL\ z — \{L\_ C L 



J k,W 



(21) 



If a certain set X 6 3z(H) were invariant, then any state in X must satisfy 
C c = 0, C w = 0. If (HI]) or (HI hold for any p e 3 Z {H), then J Z (H) cannot 
be invariant. □ 



The following iterative procedure constructs an open-loop Hamiltonian term 
H c that ensures that no invariant set exists with support on Hz alone. 

Design Procedure: Pick a basis accordingly to the decomposition Hs®Hc® 
Hr, represent all the operators in matrix form and set the index j = to begin 



the procedure. Let us rename H 



(o) 
c,z 



H 



c,z 



H (0) 



H Q , — L k . 



1. Consider Hfp ®H Z \ and partition H^\L^P accordingly; 



If 



(j) 
k 
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2. If there exist k such that L^ w ^ 0, build an orthogonal decomposition 

Uf = n { S +1) S n ( i +1 \ where H { £ +1) = Unspan(L| j j|) (notice that in 

(lit 

matrix representation ;' is a column vector of the same dimension of 

1 k.W 

T-L^P)- In a basis chosen accordingly to the new decomposition, we have 
Lf w = (^' +1 ),0, ... ,0), with £^' +1 ) ^ 0. By condition dHJ) of Lemma 

14. 1[ no state with support on can be invariant. 

3. If L^ w = for all fc's, proceed by computing V$ := -iH { ^ w -\ J^k L kY lU) 



k,Z m 



(a) If Vyp = 0, add a Hamiltonian compensation term such that 



H^yy = (h^ , 0, . . . , 0) in the current basis and zero elsewhere, with 
> 0, and recalculate Vp ; 

(b) Build an orthogonal decomposition = Hc 3+1 ^ ®'Hz +1 \ where 
Ui 0+1) = linspan(yp- j)t ). By condition ([20]) of Lemma O] there can- 
not be invariant states with support in T-Lg ■ 

4. If = {0}, exit the iteration. Otherwise, increment j and proceed; 

The above procedure ends in a number of steps equal to the dimension of the 
initial H. Let us define: 

H e = -£H<p. (23) 

j 



Proposition 4.2 The dynamics driven by (@|, with = L k , and H' = H a + 

H c + Hf does not admit any invariant set with support in %c ® T~Lz- 

Proof. By following the procedure above, we construct a sequence Hq . , with 
j = 1, . . . , m. Let us proceed by (finite) induction. Consider the last orthogonal 
subspace Hq . By construction, it cannot support invariant states, and hence 
subset. Next, assume by induction that no invariant state can have support 
on %^ l ~ k ' > ... %(?\ and consider adding 'H^~ k ~ 1 \ If a state has non- 
trivial support on k , by the construction above it is not invariant. In 
fact either the upper-left or the off-diagonal block of the generator (opportunely 
partitioned) will be different from zero. Since Uf =U$ ®...®U&\ there 
cannot be invariant states with support on TLz only. But given the form of Hf 
and applying Proposition [2T] there cannot be invariant states with support on 
T-Lc®T~Lz- It is easy to show [42] that, by linearity of the evolution and convexity 
arguments, if a certain set of states is invariant for the evolution, an invariant 
state must exist within the convex hull of the invariant set. Hence no invariant 
set with support on Hr exists. □ 

Remark 1: This result shows that there exists an open- loop Hamiltonian that 
"destabilizes" any state or subset with support in Hz alone, and gives us a way 
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to iteratively construct one. While the precise choice of the additional Hamilto- 
nian we suggest may not be practical in most situations, a generic Hamiltonian 
of the form 



(° 








H c = 


H c ,c 


H c ,w 


V o 







will serve the scope. Proving this fact rigorously goes beyond the scope of the 
present work, but the argument would follow that of Section III.B of [43] . 
Remark 2: Notice that by choosing the Hamiltonians as in (fT5)) we decoupled 
the roles of the opendoop Hamiltonian and of the feedback Hamiltonian. In 
some other cases, assuming a different form of the feedback Hamiltonian Hf, 
would also serve the scope of destabilizing the undesired invariant sets once 
the control is set to some constant: this is the case, for example, of the spin- 
system stabilization of [31] which exploits the fact that the feedback Hamiltonian 
simultaneously couples all the energetic levels. 

No matter how it is obtained, such an opendoop Hamiltonian is key element 
of our control strategy to globally stabilize pd- 

4.2.2 Feedback stabilization of the SME 

We are now ready to prove that the strategy developed for spin systems in |31| 
works also for the wider class of models we consider here, provided we allow for 
some freedom of choice in the opendoop Hamiltonian. 

Theorem 4.2 Consider the SME ^ with H t = H a + H c + u t H f , with H c as 
in ([23]) . and Lq normal with non-degenerate spectrum. Set the control law to 
be: 

1- Iftr{p t p d )> l: 

u t = -tr{i[H f ,p t ]p d ); (24) 

2. Iftr{p t p d ) < 7 /2, u t = l: 

3. If p t 6 B = {p : 7/2 < tr(p t p d ) < 7}, then u t = ~tr(i[H f , p t ]pd) if Pt last 
entered B through the boundary tr(pdp) = 7, and u t — 1 otherwise. 

Then there exists a 7 > such that u t globally stabilizes ([2]) around pd and 
E(p t ) — >• pd as t — > 00. 

We begin with a Lemma that ensure local asymptotic stability in probability 
of pd- Let us define S <E ={/)€ Q(H)\l — ti(ppd) < e}. Notice that ([2~4"]l is used 
when p e 5 <1 _ 7 / 2 - 

Lemma 4.2 The sample paths (fr(p,u) of ([2]) that do not exit the set 5<i_ 7 /2 
converge in probability to pd as t — > 00. 
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Proof. Consider V^/o) = 1 — tr(pdp) 2 . It is straightforward to show that Vj^p) > 
0, with equality if and only if p = p d - Moreover, by using the fact that [pd, H ] = 
[Pd,H c ] = [pd,L k ] = 0, we get: 

AV 2 (p) = -2tT^p d (^(H u p)) + ^2v(L k ,p)jtT(p d p) 

-tT( Pd g(L ,p)) 2 

= 2utr(i[F f ,p]))tr(p d p) 

-477 (2U(L 0)S ) - tr((L + 4)-°)) * tr{p d p) a . 

Cho osing u = — tr(i[Hf, pt]pd) we have that AV2(p) < 0, and hence by Theorem 
lA.jF we have that the paths that do not exit the set <S<i_ 7 /2 converge in prob- 
ability to the largest invariant set in Z = {p G Q(H)\AV2{p) — 0} n 6><i_ 7 /2. 
Since the choice (j2~4")l of control makes AV2 the sum of two squares, the points 
in Z must make zero both. Focusing on the second term, tr(pdPt) = only 



outside the set <S<i_ 7 /2 7 so we must have 



25R(i ,s) - 2tr(L?p) = 0, 

Lq being the Hermitian part of Lq . Notice that Lq must have the same block- 
diagonal structure of Lq. Since 



-iu t ti ^L*(F{H t ,p) + V ( L ^p))^j dt 



dtr(L^p) = 

+2^jtT(L^g(L ,p))dWt, 
a necessary condition for the invariance is then 

tT(L*g(L 0> p)) = tr((L#L + l\l$) P ) - 2tr(^p) 2 
= 2Var(L*,p)-tT(i[LX,L$]p)=0, 

where Var(X, p) = tr(X 2 ,p) — tr(Xp) 2 , and Lq denotes the skew-Hermitian 
part of Lq. Recall we assumed Lq to be a normal matrix, so that [Lq , Lq] = 0. 
On the other hand VarfX^,/}) = if and only p — TLj, with Hj a (rank-one) 

spectral projector of Lq . Since the only such state in 5<i f /2 is Pd, we get the 

conclusion. □ 

Proof of Theorem \4-S\ The proof is identical to that of Theorem 4.2 of [5T] . 
with only two differences: 

• Lemma 4- 3 and 4-4 in I2ZF are substituted by the following argument: 
Proposition 14.21 ensures that there are no invariant subspaces for the ME 



3 The fact that all the conditions of the theorem are satisfied follows from Propositions 3.4 
and 3.6 in |31j . that directly carry over to our setting. 
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(|3]) when H = H a + H c + H f. Hence, Proposition ^ . 1 1 guarantees that when 
Ut = 1, for any finite T, 

X (p) = min EVitpt) < 1; 
te[o,T] 

• Lemma 4-8 in \31f is substituted by Lemma \4-.2\ above; 

The rest of the Lemmi and arguments of the proof do not depend on the specific 
form of the operators H, {L^} but on the property of the solutions of @, and 
carry over to our case directly. □ 



5 Conclusions and outlook 

In this paper we showed how open-loop Hamiltonian control can be sufficient 
for pure state (or subspace) stabilization when suitable measurement processes 
can be enacted, or dissipativc environment are present. The key is to have non- 
hcrmitian noise operators, with an upper block-triangular matrix representation, 
that can effectively "pump" the state towards the desired subspace. In this 
case, stabilization of a pure state or a subspace for a time-invariant ME implies 
stabilization in probability for the underlying SME, linking the result to the 
analysis developed in gTJ H2J 03] . 

When open-loop stabilization is not viable, we showed how adding a switch- 
ing feedback controller on top of a suitable designed Hamiltonian perturbation, 
pure state stabilization can be achieved in expectation. The measurement op- 
erator is here requested to be associated to a normal matrix, e.g. Hermitian or 
unitary. While the proof of stability in this second scenario relies on the use 
of the support theorem and on the results of [31 j , it is worth highlighting some 
key technical differences and potential advantages of our result with respect to 
the existing ones. 

We assumed to have some freedom in constructing open-loop, time invariant 
Hamiltonians, and considered additional noise operators in addition to those 
induced by the measurement: it has been shown that, when the action of the 
noise does not prevent stabilization, it can actually be useful for the scope. For 
example, in the proposed design algorithm in Section r4.2.1[ the presence of extra 
noise, "mixing" the degrees of freedom in the T-Lr subspace could simplify the 
structure of the open-loop Hamiltonian, or even make it completely superfluous. 
In Proposition 13.11 and in particular in Lemma 13 . 1 1 we used a system-theoretic 
argument that allowed us to show that the switching controller destabilized other 
undesired equilibria for a quite large class of SMEs; similarly, Lemma 14.21 shows 
that the control law (|24|) locally stabilizes the target state for the same class of 
models. In the process, we derived also necessary condition on the structure of 
the Hamiltonians and the noise operators for achieving stabilization. 

Lastly, in our approach the use of feedback is minimized, and the associ- 
ated Hamiltonian has a simple structure. This suggests that the need for the 
computationally-intensive integration of the SME could be potentially reduced, 
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addressing one of the critical obstacles to employing filtering-based feedback 
strategies for high-dimensional systems. More precisely, the switching times de- 
pend on the value of the function fi(pt) = tv(ptpd) = 6 K, and when the 
time-dependent stabilizing law is needed, this takes the form 

u t = -tr(i[Hf,p t ]p d ) = -2i^s(Hf iP p' P ) = -2i$s(H f . v p* tu ). 

Hence, the real-time knowledge of only two parameters (ps,pu) of the state 
matrix is needed for the feedback law, hinting that a lower-dimensional estima- 
tor could be potentially used [151 [32] • Further investigation of this intriguing 
possibility is needed in order to verify whether this is a viable research direction. 

A Stochastic differential equations: support the- 
orem and Lyapunov stability 

In this appendix, we briefly recall the support theorem of [3 1 j and a few tools 
of Lyapunov stability theory for stochastic systems, specialized to the case of 
stochastic master equations. 

A.l Support theorem 

Theorem A.l (\31tf. Thru. 2.4) Let M be a connected, paracompact C°° -manifold 
and let X k , k = . . . n be C°° vector fields on M such that all linear sums of 
X k are complete. Consider the Stratonovich equation 

n 

dx t = X a (x t )dt + ^X k (x t )odWt, x = x. (25) 

k=l 

Consider in addition the associated deterministic control system 

-x? = X (x?) +"£x k (x?)u k (t), xl=x (26) 

k=l 

with u k E U , the set of all piecewise constant functions from R + to K. Then 

S x = {x? :«£«"} C W x (27) 

where W x is the set of all continuous paths from R + to M starting at x, equipped 
with the topology of uniform convergence on compact sets, and S x is the smallest 
closed subset ofW x such that P({uj £ £1 '■ X.{uS) € S x }) = 1. 

Similar forms of this theorem can be found in [22j [21] . 
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A. 2 Stability for stochastic systems 

Let M. be an invariant set of (O, i.e., if p G M, <&t(Po) € M for all t > 0, a.s.. 
Define a distance between a state and a set by 

D(p,M) := inf \\p-a\\. (28) 

Then, the stability of the invariant set is defined as follows. 
Definition A.l An invariant set M. of the SME HP is said to be 

• stable in probability if for any e > 

lim P[ sup Q(<f> t (po),M) > £ ] = (29) 

• globally asymptotically stable in probability if it is stable in probability and 
for any p e D(H) 



P llimd($ t (p ),M) = =1. (30) 

\t— >oo / 

The following two theorems are the stochastic counterparts of the Lyapunov 
conditions and the LaSallc invariance principle [MJ [531 [Ml US] ■ We denote by 
A the infinitesimal generator of the Markov semigroup associated to the SME 
([2). Explicitly, it can be written in the following "symmetrized" fashion 

+ is 2 (C„))|H + i^ (c , ( , t)) ), 

We use the following notations. 

• Q m := {p 6 S(H) : y(p) < m] 

• is in the domain of the infinitesimal generator A of the diffusion. 

Theorem A. 2 Assume that $t(po) is a right continuous strong Markov process 
defined at least until r > r m with probability 1, and that there exists a function 
V in the domain of A such that 

1. V(p) = for any p E M, 

2. V(p) > for any p M, 

3. AV(p) < for any p G Q m . 
Then Ai is stable in probability. 
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Theorem A. 3 Let AV(p) < in Q m - Suppose Q m has a compact closure, 
$t(po) is Feller continuous, and that P(\\$>t(po) — Poll > e) — > as i — > for 
any e > 0, uniformly for po G Q m . T/ien &t{po) converges in probability to the 
largest invariant set contained in C m = {p G Q m '■ AV{p) = 0} for almost all 
paths that do not leave Q m - 
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